METHOD AND APPARATUS FOR ACQUIRING AND PROCESSES TRANSDUCER 
DATA 

REFERENCE ^RELATED APPLICATIONS 

[0001] This application is related to Provisional Application serial nos. 60/415,772 filed 

October 4, 2002, and 60/ filed September 26, 2003, the teachings of winch are 

incorporated herein by reference. 

OOVERN MENT RIGHTS 

,00021 This invention was made pursuant to U.S. Government contract nos. F33615-03- 
C-1437 (USAF); F33615-02-M-1 189 (USAF); and DASG 60-030P-0280 (U.S. Army Space 
and Missile Defense Command). 
RACKCRO TTMn OF THE INVEN TION 

,00031 The present invention pertains to a method for establishing a common basis for 
the exchange and processing of transdncer (i.e. sensor and emitfer) data acquired from a 
plurality of diverse transducers. In particular, me invention pertains to a method and 
apparatus for providing a common basis for capturing data in rea. time from dtversc 
transducers. The data may be used immediately or may be archived without corruption. 

,0004] Currently standards exist for the capture of data. However, current standards do 
no, meet the accuracy and efficiency requirements for capturing in real-time mulfi-sensor 
data, indeed, the failure to characterize data as sensor data misdirects the task and 
undermines the objectives of efficient and effective data capture. 

[0005] In many data capture applications, it is desirable to obtain data from one or more 
transducers a, various locations. These dafa may be produced by various devtces and may be 
expressed in a variety of forms, m order fo be usefut in a meaningful way, fhese dafa must 
be processed and correlated. However, the data is difficult to correlate because dafa from on, 
type of transducer maybe incomputable with tire data fiom ofher types of transducers, and « 

is necessary to reconfigure the expression of ft. data in order to facilitate .heir utilization. 

Such reconfiguration sometimes results in a corruption of me dafa from ifs onginal form, 

which in turn results in a loss of accuracy. 

,00061 In addition, these data must be appropriately organized so fha, data from related 
devices may be accurately tracked in time and space. Such organization requues the 
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generation of metadata, i.e. data abon, data, having a complexity wh,ch increases as -he 
complexity of «he expressed form of .he uansducer data increases. Th,s complex me,a-da.a 
eonsumes valuable processor memory and diminishes processor efficrency. 
,00071 The dara produced by various transducers may be generated a, different times and 
a, different frequencies or intervals depending on the system recrement, For example r, 
may be necessary no record the position, or temperature of a sensor !ess frequently than rt ,s 
necessary ,o record the image produced by such sensor. This is because me image may 
change more frequent* than the temperature of the sensor, and the motion of.be sensor may 
be uniform, and hence its position may be readily computed. 

,00081 A, the same time, it may be necessary, in a particular application, to correlate the 
primary image data with the secondary temporal, positional and temperature data. In 
conventional systems this secondary data may be inserted m a header as meta-data precedmg 
the image data. This form of data acquisition results in high processor overhead, and » 
inefficient and inconvenient to handle. 

[00091 Finally, it is difficult to transmit large amounts of data in an efficient manner, 
especially where the large amounts of complex meta-dara are involved. Here too, 
complexities associated with the diverse expression of data increase communicauons system 
requirements, particularly bandwidth and processor speed. 

"T TT 1H j P v QF f"" TNVF.NTION 

,000101 The invention is based upon .he discovery that transducer data may be expressed 
„ modeled uniform., in terms of a Transducer Charac.crrstic Frame (TCF). Each transducer 
will have a unique TCF. A.l models for a transducer will employ the same TCF structure. 



a. clusters 

b. TCF 

c. Samples 

d. Measurements 



,000111 Mode!s or descriptions of data follow a preselected hierarchy of measurements 
samples and dusters. Spatial, timing and sequencing characteristics of the data employs .he 
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TCF. Data is correlated from any arbitrary set of transducers using the model and data 
structure. Interpretation of data from the arbitrary set of transducers is achieved by 
interpolating samples occurring during successive acquisition time intervals or ticks. Data is 
communicated from any transducer using the preselected hierarchy. 

BRIEF DESCRIPTION OF THF. DRAWINGS 

[00012] Fig. 1 is a schematic illustration of a sensor showing the stimulus and the response 
characteristics. 

[00013] Fig. 2 is a schematic representation of an in-situ sensor and its corresponding 
response. 

[00014] Fig. 3 is a schematic block diagram of a remote sensor showing the instantaneous 
field of view and the corresponding response. 

[00015] Fig. 4 is a schematic illustration of an active remote sensor showing IFOV and the 
characteristics of the source illumination and response. 

[00016] Fig. 5 is a schematic representation of a scanning IFOV remote sensor showing 
object and image space. 

[00017] Fig. 6 is a generalized illustration of sensor frames showing dimensionality and 
relative timing samples for diverse sensors. 

[00018] Fig. 7 is a schematic representation of a framing sensor showing the derivation of 
look angle vectors. 

[00019] Fig. 8 is a schematic representation of coordnate TCF samples for various sensors. 
[00020] Fig. 9 is a description of spatial and timing data for a line sensor. 
[00021] Fig. 1 0 is a description of the IFOV distribution for a sensor sample. 
[00022] Fig. 1 1 is a description of the response spectrum of a sensor over its response 
range. 

[00023] Fig. 1 2 is an illustration of the stimulus-response transfer function of an 
exemplary sensor. 
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[00024] Fig. 13 is a schematic illustration of a sample order for a sensor and a 
corresponding different transmission order for the same device. 
[00025] Fig. 14 is a depiction of a basic Cartesian coordinate systme 
[00026] Fig. 1 5 is a depiction of a basic polar coordinate system. 
[00027] Fig. 16 is a depiction of an earth centered coordinate system. 

[00028] Fig. 17 is a depiction of a platform coordinate system. 

[00029] Fig. 18 is a depiction of coordinate transformations in euler angles. 

[000301 Fig. 19 is an illustration of an exemplary coordinate transformation. 

[00031] Fig. 20 is an illustration of an exemplary interpolation. 

[00032] Fig. 21 is an illustration of exemplifying the relationship of sensor data taken at 
different rates. 

(00033] Fig. 22 is a generalized schematic block diagram of the overall system according 
to the invention. 

[00034] Fig. 23 is a generalized schematic diagram of a conventional system. 
[00035] Figs 24°- 24c are schematic block diagrams of various embodiments of a 
generalized system according to the invention. 

[00036] Fig. 25 is a schematic block diagram of an airborne capture and transmit system 
according to the invention. 

[00037] Fig. 26 is a schematic block diagram of a terrestrial or ground receive processing 
and display system according to the invention. 

[00038] Fig. 27 is a graphical representation of a model curve, which exemplifies a 
frequency response curve. 

[00039] Fig. 28 is an example of an encoding fragement. 
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nPSCRTPTIO" nv TOR TNVENTION 

[000401 The invention is directed to a method and apparatus for collecting, organizing, 
correlating and communicating transducer data from a plurality of diverse transducers. A 
transducer is any device which produces an output which may be monitored. Transducers 
may include known sensors or emmitters of various types which are discussed below. 
Transducers may also include devices yet to be developed, but which according to the 
invention, may be readily incorporated in accordance with the TCP of the newly developed 



sensor. 



[000411 As used herein, a transducer may be defined as any device that produces a 
response as a function of a stimulus (i.e. a sensor); or a device that produces transmitted 
energy (i.e. an emitter). The term transducer is general and is used as such; the terms sensor 
and emitter are particular examples of specialized transducers and are used throughout tins 
discussion as appropriate. Fig. 1 illustrates a sensor producing an output (response) m 
response to an input (stimulus). 

[00042] There are basically two general types of transducers, namely: in-situ transducers 
es and remote transducers. In-situ sensors are transducers that make measurements at the 
origin of the stimulus. They are typically in contact with an object of which a measurement 
is made. Some examples are pressure and temperature sensors, rotational encoders, geo- 
positioning satellites (GPS) and internal measurement units (IMU). Fig. 2 illustrates an in- 
situ sensor in contact with an object and its response. 

[00043] A remote transducer, which can be active or passive sensor, measures 
characteristics of the environment represented by the state of a remote object. Remote 
sensors typically measure energy modulation. A remote sensor can be characterized as 
having an Instantaneous Field Of View (IFOV). Fig. 3 illustrates a passive remote sensor 
with an IFOV wherein the information detected by the sensor is reflected energy. Such 
sensors measure the emitance and reflectance of an object. Such sensors typically rely on the 
illumination from ambient sources for their reflected illumination. 

[00044] Active remote transducers are sensors that provide the necessary illumination in 
order to measure the reflectance from the object. The characteristics of the illumination 
source must be known. Fig.4 illustrates such an active sensor wherein an illumination source 
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or emitter produces illumination and the sensor is responsive to the reflected energy from the 
object IFOV. In the example, the illumination source and sensor are each considered to be 
transducers. 

[00045] Emitters can be generally characterized as transducers which are the reciprocal of 
a remote sensor. Instead of an input energy producing a response signal, an emitter uses an in 
put signal to produce an output energy. 

[00046] Remote sensors may be further employed to scan the IFOV in order to cover a 
wider field of view (FOV) by taking many samples, each sampling different space of their 
own IFOV. As shown in Fig. 5, remote sensors, which scan the IFOV in the entire FOV 
either by sequencing multiple detectors or by moving the IFOV of a single detector and 
taking multiple samples from that detector during the motion are referred to as scanning 
sensors. The scanning of a remote sensor is typically implied in the data structure of the 
sensor response. Some imaging sensors rely on IFOV scanning to produce an image of the 
object space. Some sensors known as framing sensors do not scan, but have multiple 
detection with individual IFOVs arranged in such a way so as to cover a large field of view. 
Samples making up a frame form a framing sensor are all from the same instant of time. The 
sample from a scanning sensor have sequential time sampling over an imaging interval. 
Although the data produced by such diverse systems have different characteristics, the 
invention provides a method and apparatus for combining the data from any number of 
diverse transducers. 

[00047] The structure of all transducer data is described in the following hierarchy. 

[00048] 1 . Transducers produce measurements. A measurement is a single data point. 

[00049] 2. A transducer sample comprises one or more measurements. Every 
measurement in a sample corresponds to particular temporal and spatial coordinates. 

[00050] 3. A Transducer Characteristic Frame (TCF) comprises a set of transducer 
samples. The TCF is the minimum set of samples that must be considered in order to 
characterize the transducer. 

[00051] 4. Transducer data is sent in clusters. A cluster is a specified whole TCF. A 
cluster may be a portion or set fraction of a TCF when the TCF is very large. 
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,000521 The invention provides a method and apparatus for: (a) desonbing (that is, 
modelutg) the particular data structure of any transducer relative to the hierarchy of 
llreLs samples, TCP and clus,ers; (h, —eating the data from any transducer 
using this hierarchy; and (c) correcting the data from any arbtirary se, of transducers ustng 
the model and data structure. 

,000531 Transducers are normalized by providing a universal method of modeling 
transducer data baaed on a transducer characteristic frame (TCF). 
,000541 Certain terms are used throughout the description and are thus introduced 
generally below. 

,000551 The Transducer Characteristic Frame (TCF) is a se, of samples comprising a 
Lea of measurments organized so as to compartment the measurements in a way ha, 
resembles ,he physical layou, of ,he transducer. If, for example, me transducer ts a push 
broom scanner having 1 x n pixels, the TCF will be organized in a 1 x n array. 
,00056, A model represents a feahrre of ,he transducer which may be expressed. For 
example, a pixel may have a selec.ed orinetation wi,h respec, ,0 the focus of a camera. Th, 
:Z ti :„ has two spatial components, some,.me S referred ,o as alpha (a, and beta 0> ang e 
« described using a spherical coordina,e sys,em. According ,o ,he inven.ton, me model for a 

numbers for ,he f componen, of each 1 x n pixel. Cher feamres, desenbed heremafter, w,U 
^edmlsamewayso^allmode.ofda.looUi.emeTCFofme^. 

The models appear as layers having me same appearance or con-esponding properites and 
characteristics of a transducer. 

,00057, The dimensionality charac,eris,ie of the TCF is the number of object space 
oordia.es needed to specify the spatial characteristics of each transducer sample relative o 
a transdueer reference system. !n norma, three dtmensional space, the dimenstonah y can be 
LTone two or three. It should be understood tha, dimenslonaltty is no, so linu.e , bu, may 
be easily expanded if desired. Each dimension of the TCF can be assigned a spatial 
eoord,na«e from one of the coordinate systems. In the exemplary embodiments desenbed 
herein, ,he object space can be either Cartestan coordinates, i.e. x, y, z coordma.es, or 
sph erica, coordinates, i.e a, p, r coordinates. However, „ should be u„de,s,ood tba, any 
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coodinate system (such as cylindrical) may be adopted and incorporated into the system of 
the invention. 

[00058] In situ transducers which have no IFOM have a single sample and have a 
dimensionality of zero. Examples of zero dimensional (that is, non-dimensional) transducers 
include rotational encoders, thermocouples, voltmeters, global position system (GPS), 
microphones and inertial navigation sensors shown in Fig. 6. Non-dimensional transducers 
are usually in-situ sensors. A single sample may have one or more measurements. For 
example, a thermocouple may give a temperature measurement. A global positioning system 
(GPS), on the other hand, may produce latitude, longitude or altitude measurements in a 
single sample. 

[00059] One dimensional TCFs use one coordinate from the set of object space 
coordinates to characterize the spatial characteristics of each sample within the TCF. A radar 
sensor or a depth sounder are examples of a one-dimensional TCF, because each sample m 
the TCF represents the response or stimulus at a certain range from the transducer. See Fig. 
6. 

[00060] Two dimensional TCFs use two coordinates to characterize the spatial relationship 
of each sample. Most imagining sensors have a two-dimensional TCF. An n x m framing 
sensor or a pan scan sensor, depicted in Fig. 6, are examples of two dimensional sensors. The 
dimensions on the TCF can be any pair of coordinates taken from the coordinate systems 
(Cartesian, spherical, etc.). 

[00061] In accordance with the invention, all TCF models of a particular transducer have 
the same TCF configuration. If the TCF is 11,000 samples in a 50 by 220 grid, then all 
models will have 1 1000 values in a 50 by 220 grid. If the TCF is a 4 x 4 grid, the models of 
the data will be 4 x 4 as well. There is a one to one correlation between the samples of the 
measurement TCF and the tcfmodels. Some common models of transducers include a 
coordinate TCF model; a temporal TCF model; and a sequence TCF model. Certain 
transducers have additional models which may be employed to describe changes between 
samples particular to the transducer samples, for example, radiometric gain. In addition, 
models may be added as required to describe additional relationships as they become 
relevant. Any characteristic used to describe a sample which varies over the TCF may use a 
TCF model to describe that variance (e.g. measurement duration, gain). 
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[00062] A coordinate model defines the spatial ambiguity of transducer samples. There is 
a coordinate model for each coordinate of a TCF. For instance, a two-dimensional TCF of 50 
x 220 samples would have two coordinate models each with 50 x 220 cells. 

[00063] The coordinate model associates the transducer samples to the physical world. In a 
framing sensor camera, for example, having a 4 x 4 array of 16 pixels, as depicted in Figs, 6 
and 7 each sample has two dimension spatial components, namely a and p, associated in 
each sample dimension, x and y. There are 2-dimensions modeling 3-dimensional space, 
leaving one dimension ambiguous. The spatial ambiguity for a camera illustrated in Fig. 7, is 
based on the fact that rays pass through a vertex point located at the origin of the transducer 
reference system to strike the transducer lying in a focal plane. In Fig. 7, the sample m the 
upper right hand corner (sample: x=0, y=4) will be pointing at an angle a (0,3) with respect to 
the transducer reference system ; and at an angle P (0,3) with respect to the transducer 
reference system . The sample (0,0) in the upper right hand corner will be pointing at a 
different angle a (0,0) and P (0,0). Likewise, each pixel has a corresponding alpha and beta 
measurement associated therewith. The alpha and beta measurmentscontained in a TCF 
structure called a tcfmodel, so that the data is self consistent. Examples of the alpha and 
beta tcf models for the arrangement of Fig. 7 are illustrated in Table I. 

TABLE I 
a (x,y) 



a (0,0) 



a (0,1) 



a (0,2) 



a (0,3) 



a (1,0) 



a (1,1) 



a (1,2) 1 
a (1,3) 



a (2,0) 



a (2,1) 



a (2,2) 



a (2,2) 



a (3,0) 



a (3,1) 



a (3,2) 



a (3,3) 



P (x,y) 




[00064] Different transducers have different spatial characteristics . Fig 8, for example, 
illustrates TCFs for four types of sensors including: a 4 x 4 framing sensor; a 1 x 16 
pushbroom sensor; a 2 x 13 line scan sensor; and a 1 x 12 conical scan sensor. The 
TCF for the 4 x 4 framing sensor is similar to the arrangements of Figs. 6 and 7. The alpha 
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and beta values in the TCF for certain ones of the measurments are shown schematically as 
arrows labeled for the particular pixel. The orientation of the transducer reference system xs 
chosen such that the set of coordinates chosen model the ambiguity space (if any) of each 
sample. 

[00065] The pushbroom sensor has alpha and beta measurements for the sample look 
vector in the TCF shown as arrows. The hue scanner shown in Fig. 8 has the alpha and beta 
values identified in accordance with the TCF of a line scanner. The conical scan sensor also 
shown in Fig. 8 has a model of the alpha and beta values described as a 1 x 12 array of 
arrows. 

[00066] The values in a coordinate model provide a common way to describe these 
different spatial ambiguities. The range of one dimension is divided up into a specified 
number of equal distance intervals called ticks. Fig. 9 illustrates an example of a simple two- 
dimensional coordinate model for a 1 x 7 sensor . Each tick represents an interval in a 
coordinate model. The ticks allow the range of the coordinate to change without changing 
the tick count for each sample. 

[00067] In Table II, the model for each sample 1-7 is shown in object space coordinates a 
and p for corresponding Image Space Coordinants. 

TABLE II 



Sample 


1 


2 


3 


4 


5 


6 


7 


Image Space Coordinate x 


Xi 


x 2 


x 3 


x 4 


X5 


X6 


x 7 


Image Space Coordinate y 


yo 


yo 


yo 


yo 


yo 


yo 


yo 


X Vector Frame A (Ticks) 


-12 


-8 


-4 


0 


4 


8 


12 


Y Vector Frame B (Ticks) 


0 


0 


0 


i ° 


0 


0 


0 



[00068] Note that the sample image space 
same TCF configuration for a 1 x n sensor. 



coordinates and vector frame a and p have the 



[00069] Functional models provide a way to represent functions. For example, the 
Instantaneous Field of Measurement (IFOM) ; the input/output transfer function (TF); and the 
frequency response are illustrated in Figs. 10, 1 1 and 12 respectively. In Fig. 10, the 
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response characteristic for a pixel element varies over the IFOV, and this variation is 
characterized as a value over a selected number of spatial ticks. It should be noted that the 
distribution of spatial and timing coordinates do not need to create symetrical rectagular 
arrays. The distribution of samples may be random in either space or time or both. 

[00070] Fig. 1 1 is a normalized response function showing frequency response over a 
norminal bandwidth. Fig. 12 shows the normalized input/output transfer function over a 
range of stimuli. In each case, the data representing IFOV Response, frequency response and 
I/O response may be expressed in terms of the TCF for each sensor element (i.e. may vary as 
a function of a sample position with the TCF). 

[00071] The invention thus provides a means for not only modeling the sample 
measurements, but also provides a means for modeling the various characteristics associated 
with those transducer measurements. A sample has a set number of measurements. Each 
measurement has an arbitrary number of properties and characteristics. For the invention, 
properties are simple name-value pairs e.g. frequency - Hz; angle - radians; volume - db; 
color - yellow and the like. 

[00072] Characteristics are a combination of related properties. Characteristics may also 
include a curve, such as a simple sequence of numbers that maybe interpreted as a graph or 
curve. These curves represent variations inherent in measurements. In a camera, for 
example, depending on the position of the pixel with respect to the central axis, the sensitivity 
of the pixel may be higher or lower than a nearby pixel. Alternatively, the frequency 
response of a sensor may vary over a range. The curve in Fig. 1 1 illustrates this 
characteristic. Fig. 12 illustrates a response of a pixel or detector compared with the 
stimulus. In other words, the response is a function of the stimulus and must be taken into 
account. The correction factor for each pixel can be characterized by using a TCF_model of 
the transducer. 

[00073] The temporal model defines the relative time delays or offsets of each sample 
within a TCF relative to the first sample. The temporal model uses the TCF. Like the 
coordinate model, the values in the temporal model are given in time intervals also referred to 
as ticks. Table in illustrates an example of a two dimensional temporal model using time 
ticks. 
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TABLE III 



Sample 
4x4 Scanning Sensor 
(Ticks) 


Tl 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


12 


13 


14 


15 


16 




0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


/\ 

V 


U 


A 
U 


4x4 Pan Line Scanner 


0 


0 


0 


0 


71 


1 


1 


1 


2 


2 


2 


2 


3 


3 


3 


3 


(Ticks) 
Line Scan Sensor 


0 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


12 


13 


14 




(1x15) (Ticks) 
Push Broom Sensor 
(1x15) (Ticks) 


0 


0 


0 


0 


0 


0 


0 


0 


0 


1 ° 


0 


0 


0 


0 


0 





[00074] Functions or curves can oe uc^nuw VJ — 0 

f mode. The range and/or endpoints of .he independent variable comes from rhe ealhng 
eremen. for the , model. The fmodel contains the se, of data points represent the 
dependent variable spread hnear.y or logarimmically aeross the range of the independent 
variabie. There may be one or two independent variab.es such ma, two or three dtmens.ona, 
functions can be modeled. 

[000751 In a framing sensor snch as shown in Fig. 6, all samples of a TCF arc taken 
sintnltaneonsly, thai is, there is no time offset between fhe ftrs. measuremen, in a samp* and 
any other measurement in a sample in fhe frame. Accordingly, the temporal model of the 
framing sensor is represented by a 4 x 4 matnx of zeros in each of the boxes. 

,000761 Fig 6 also shows a pan scan sensor, where each sample in a line is taken a. the 
same toe. The second, third and fourth lines are santpleo on later ticks. As shown the firs, 
line is a. tick time zero (0) and lines 2, 3 and 4 are on successive correspond ticks (1), (2) 
and (3) respectively^ .Unstated by the numerals inscribed in the boxes. It should be noted 
that tick increments can and shou,d be much faster than the increment between samples so 
that nonlinearities in timing can be characterized. 

■00077] For the 1 x 15 push broom scanner, as illustrated in Fig. 6, the samples are taken 
a, the same time tick zero. Thus the zeros are inscribed in all of the boxes. For the 1 x 15 
Une scanner in Fig. 6, me measurements are taken on successive ticks, hence fhe numbers 0, 
1, 2 ....14 inscribed in the boxes. 

,000781 The TCF is comprised of a se, number of samples. Each sample is comprised of a 
se, number of measurements. For i„s,ance, a camera may have ,000 by 1000 samples, called 
pixels within its characteristic fiamework. In the example, me 1000 X 1000 samples makes 
an image having 1 million pixels (or 1 megapixel). If the camera is a black and wht.e 
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camera, then each sample has one measurement that may be a gradient of black, e.g. 256 grey 
scales. If the camera is a color camera, then each sample has three measurements, one for the 
gradient of cyan, magenta and yellow, or red, green, blue. In either case, the samples are 
contained in the TCF, and there will be a sample of 1 million samples Each sample within 
the TCF has a corresponding coordinate, time and sequence to describe its relative or internal 
spatial orientation, its internal or relative timing relative to other samples within the TCF, and 
its sequence order in the transmission stream such that it can be sorted into its internal sample 
sequence. For example, for the black and white camera, the data will be sent in a string of 

binary data. The data may look like a string of numbers ***; ***; ***; This data string 

represents, for example grey scales whic follow the TCF of the sensor 

[00079] If the device is a color camera, which has three measurements, for example Red 
(R); Green (G); and Blue (B) for each sample, the data will be sent by interleaving the binary 
measurement from each measurement. The data will be in groups of three measuments 
which have the form: ***, &&&, %%%; ***,&&&,%%% 

[00080] The sampling order is the order in which the samples are taken. The sequence of 
samples can be any desired order. The sampling order is given by the spatial or temporal 
orientation of the samples within a TCF. This order may be disturbed during the serial 
transmission of the data. The order in which the samples are transported shall be the same as 
the order in which the timing and coordinate TCFs are transported. To retrieve the original 
order, the coordinate TCFs can be sorted to retrieve the spatial order. The original temporal 
order will then result from the similar sorting of its TCF. To facilitate the sorting, a TCF will 
be used which gives the intended numeric position of each sample in the transported TCF 
(Fig. 13). 

[00081] The order in which transducer samples of a measurement TCF are transported 
through a communication channel i.e. Sequence TCF, may vary greatly and may not always 
represent a left-o-right, top-to-bottom, front-to-back scan of the TCF structure. One way to 
organize the data such that the data is organized spatially correct is to sort the data samples 
according the the coordinates of the coordinate TCF's. This sorting although possible may be 
a computationaly intensive task. To facilate the sorting a sequencing TCF is introduced (Fig 
13.). 
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[00082] One way to describe the sequence is to order all of the samples in their intended 
order and give them a serial sequence number using the left-to-right, top-to-bottom, front-to- 
back sequence. This organization has nothing to do with the temporal order in winch the 
samples were acquired. It does relate to the relative spatial organization of the samples 
within the TCF (i.e. coordiante TCFs). There may be situtions where the intended 
organization of the data is not orthoginal (e.g. a random spatial distribution). In these 
situtuions it may be benefitial to assign a coordinate to the intended position of each sample. 
If the TCF is a 2-dimensional structure then two sequencing TCFs would be used, one 
sequence TCF for each coordiante. One sequence TCF would indicate the column position of 
the sample and the other sequence TCF would indicate the row position of the sample. 
Samples do not need to be positioned at every column-row orderd pair. If the spatial 
structure of the data is not orthoginal, then the non-orthoginal structure shall be descnbed 
using an all inclusive orthoginal coordinate space. Known approaches to the sequencmg TCF 
implement the serial sequence number or the coordinate sets to represent the row, column, 
plane position of the samples. 

100083] Encoding is a characteristic that must be defined for each measurement. The 
encoding characteristic defines the bits; the data type; the units; and the range properties of a 
measurement. The encoding characteristic provides the information required to allow 
applications to parse data within a cluster. The model can provide any number of 
characteristics for a particular measurement. Some characteristics include frequency 
response, instantaneous field of view and gain. 

[00084] The model can specify dependency, which is defined as a condition where the 
value of a property is dependent upon another property, or is dependent upon a measurement 
value generated by another transducer. As indicated above, measurement is speeded or 
identified as a name-value pair. To specify a dependency, on the other hand, a property has a 
name-dependency identifier e.g. gain - t^emUue, and the like, rather than a name-value 
pair. The invention uses the dependency identifiers to define the relationship between 
transducers to thereby define a system. 

[00085] A system is an arbitrary set of transducers. The invention characterizes a system 
by providing the individual models of the transducers and then specifying the 
interdependency of the properties of the transducers using dependency identifiers. 
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[00086] As an example, a first transducer may have variable gain dependent upon 
temperature. A second transducer may be a gain sensor . In a system incorporating these 
transducers, it would be necessary to define the properties of both transducers, and specify 
that the gain characteristic is dependent upon another value (measured by the gam sensor). 
That is, a property in the gain characteristic would have a dependency identifier; and an 
association between the gain characteristic of the data from the gain sensor would be 
specified. 

[00087] In accordance with the invention, the interdependencies are specified outside of 
the sensor models themselves. This approach enables system specifications to incorporate 
sensor models without changing the sensor models. That is, systems can utilize "plug and 
play" sensor models. 

[00088] To minimally characterize a transducer one must answer the questions of "what" 
is the measurement; "where" in space does the measurement relate to; and "when" in time did 
the measurement occur. The where (space) and when (time) characteristics are answered by a 
combination of the interior and exterior orientation of a transducer. It should be noted that 
the interior orientation is only applicable for remote transducers. There is no geometric 
interior orientation applicable to in-situ transducers. 

[00089] The transducer orientation characterizes the space-time relationship or geometry 
of the transducer data. The interior and exterior orientation of a transducer complements 
each other to give a complete space-time relationship of the data. The interior orientation is 
an orientation that remains constant with respect to the transducer reference frame 
independent of transducer position, attitude, motion or time. This orientation accounts for 
any of the scanning mechanics or the space and time relationships between the samples 
within the transducer characteristic frame. The external orientation characterizes the position 
and attitude and timing relationship of the transducer reference system with respect to an 
external reference system. The world reference system is an external spatial reference 
system that will be the common reference system for all geo-spatial data (e.g. ECEF 
reference system). 

[00090] A system of Coordinate and Reference System is used throughout this discussion. 
Figs. 14 and 15 respectively show the Cartesian and polar coordinate systems used to 
describe coordinates. 
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[00091] Figs. 16 and 17 show two reference systems used in this discussxon. Fig. 16 
shows an Earth Centered Earth Fixed (ECEF) coordinate system (further defined by WGS- 
84) Fig 17 shows a transducer reference system. If a platform reference system is 
required, a transducer shall be assigned to it so that it can be measured. There is no assigned 
orientation of the x, y, and z axis to the transduce, Any orientation may be used, depending 
which orientation works best for characterizing the intenor orientation of the transducer data. 
The description of the interior orientation may be expressed in terms of selected system 
coordinates (x, y, z, a , p , r). These coordinate assignments may be used to descnbe the 
interior orientation of the coordinate system axis to the transducer data. 
[00092] Figure 1 8 shows the convention used for determining the Euler angles (co,cp,K) for 
rotation transforms. Particular attention should be made to the order in which the rotations (k 
then cp then co) are made when defining the orientation of a transducer relative to the 
external reference. The order is reversed when describing the oritation of the external 
reference system relative to the transducer reference system. 

[00093] Key dependencies between transducers are position and attitude and their first and 
second derivatives. Position may be measured with Cartesian or spherical coordinates. The 
attitude is measured with co,cp,K known as Euler angles. 

[00094] Fig. 19 schematically illustrates an exemplary sensor S in coordinate frame Fl 
expressed as xl, yl. zl, secured in a platform (e.g. in an aircraft). A in coordinate 
expressed as x2,y2, z2 by an arm of length Rl. An IMU on the aircraft senses the attitude of 
the platform frame in coordinates co,cp,K, and a GPS senses the position of the sensors m the 
platform relative to the Earth . The attitude of the sensor S with respect to the IMU is given 
as a quantity derived from gimbol sensors Sx; Sy; Sz in frame F2 expressed as gx 2 , gy 2 , gz, 
Accordingly, all necessary coordinates are available. It is not unusual for the frames to have 
a selectable or time varying attitude which may be measured and recorded over time 
[00095] Using known coordinate transformations, the attitude of the sensor frame S may 
be fixed with respect to the position of the IMU and the position may be found relative to the 
GPS The attitude of the IMU may be translated to the GPS position assuming the IMU and 
GPS form a rigid body. For example, the position dependency of (xl, yl, zl) of the sensor 
frameA with respect to the aircraft of frame A may be expressed as fixed numbers, such as 

(12 005 -4 452, 0.216) because the arm length Rl is fixed. These numbers represent the fixed 



16 



DC01Y71 597.1 
1DUPD 



I 



positional difference, i.e. ((xl-x2), <yl-y2), (zl-z2)), between the origins of the frames Fl 
andF2. 

[00096] Similarly, when the attitude of one transducer is determined (fixed) relative to 
another transducer, the attitude dependency of (co,cp,K) is specified as fixed numbers, such as 
(0.86, -0.86, 0.13). These numbers represent the difference angle between the axes of one 
transducer with respect to another transducer. Thus, the positional transformations define the 
relationship between coordinate systems for related transducer frames. If the attitude varies 
then the attitude dependency will retarget the appropriate sensor. 

[00097] Positioning sensors are treated like any other transducer. This approach is an 
important concept of invention. Position dependency may be specified based on the value of 
a transducer measurement. For example, the attitude of gimbol sensors (Sx, Sy, Sz)may 
measure the attitude of a transducerf relative to the attitude of an IMU. The position of a 
global positioning system (GPS) sensor with respect to Earth Center Earth Fixed is dependent 
upon the position measurements measured by itself. In either case, the attitude position 
reading of a transducer is handled the same way as any other data. There are no exceptions. 
The only difference between the gimbol measurement and an image measurement, for 
example, is that the TCF of the gimbol is defined uniquely for the gimbol and the TCF of the 
image sensor is defined uniquely for the image sensor. Timing and sequencing may be 
different, but again, these are handled in accordance with the TCF of the sensor. All data 
models and identifieres follow or are layered on the TCF of the corresponding device. 
Therefore, the system has a uniform and generic process for handling and communicating 
information. In addition, because the data is accurately timed and sequenced, it is possible to 
relate the data of different transducers in space and time. 

[00098] The following is a simplified example from Fig. 1 9 which is intended to illustrate 
how these interdependencies work. 

[00099] Sensor S is a scanning sensor or camera in sensor Frame Fl . Sensor S is attached 
to an arm of a given length Rl. The arm is attached to an aircraft A, in a platform frame Fl in 
an aircraft A, with attitude measured by an IMU and position measured by a GPS. Sensor S2 
(Sx; Sy; Sz) comprises roll gimbol encoders that measure the attitude of sensor S relative to 
the aircraft gx 2 , gy 2 , gz 2 . Sensor S3 is global position system GPS that measures the position 
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of the platform relative to an earth-center earth-fixed (ECEF) coordinate system. Sensor S4 is 
an inertial measurment unit MU that measures the attitude of the aircraft relative to ECEF. 

[0001001 The resultant exterior attitude and positions are the result of individual rotations 
and translations of the coordinate frames. 

[000101] Many transducers are in reality a system of transducers. A transducer system 
topology provides the fundamental descriptions of how all of the transducer data relates. Not 
all systems are alike so the system topology is described on a system to system basis. This 
specification defines four types of relations: Attached, Dangled, Position, and Attitude. 

[000102] An Attached sensor is typically an in-situ sensor measuring other parameters to 
support its host sensor. The Attached relationship will be described in the attached sensor's 
nomenclature. An example of an attached sensor would be if one had a diagnostic sensor 
attached to the primary imaging sensor measuring another variable (such as vibration of 
temperature). An Attached element is empty and simply references another sensor. The 
presence of an Attached element means that the sensor referenced by the dependency element 
should be treated as if it had the exact same location and attitude as the sensor referenced by 



the Attached element. 



[000103] The Attached relation is used to attach sensors to transducer characteristics which 
describe changing parameters about a transducer system, such as receiver gain. The Attached 
relation implies that there is a characteristic to "hook to". The sensor is measuring a 
changing parameter for that one of the transducer characteristics that TML models. 

[000104] The Dangle dependency is like the attached dependency except that there is no 
internal hook to a transducer characteristic. The Dangle transducer simple hangs off of 
another transducer and provides additional measurement relating to the transducer as a whole. 
An example of a dangle relation would be a temperature measurement of a transducer's 
detector, to the vibration load on a particular transmitter. 

[000105] The Position relation identifies the position of a transducer relative to the earth or 
another transducer. The Position can be a fixed location or it can be variable, where the 
position is measured by a sensor. The Attitude relation is similar to the position except the 
orientation of a transducer is described relative to the earth or another transducer. If the 
orientation is variable the orientation may be described with a sensor. The Position and 
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attitude relations are the principal relations for determining the exterior onentation of any 
transducer. 

[000106] The invention also provides a method for communicating data. In accordance 
with the invention, the transducer models are sent first followed the actual data generated by 
the transducers. The models enable applications to correlate the data of transducers by 
describing (1) what the data represents, (2) how to parse the clusters of data that are sent and 
(3) how to calculate the dependencies in the data, especially the dependencies of position and 
attitude. 

1000107] Each transducer broadcasts data in clusters. The transducer model defines the size 
of the cluster. The transducer broadcasts these clusters at its own rate. Each cluster has a tone 
stamp. The cluster contains either a set number of transducer characteristic frames (TCP) or a 
set fraction of a TCF. Each TCF contains a specified number of samples. The temporal 
model of the transducer specifies the time relationship between the time stamp of the cluster 
and the samples within a cluster. An application uses the temporal model to calculate the 
time of a specific sample within a cluster. The time stamp on the cluster represents the tune 
of the first TCF in the cluster. If multiple TCFs are in a cluster the other TCF time stamps 
can be calculated by adding the TCF period to the time stamp. If a TCF is broken mto 
multiple clusters all clussters shall have the same time stamp. 

l0 00108] A system defines that the properties of certain transducers are dependent upon the 
values of the data created by other transducers. Most notably, the position of one transducer 
will be dependent upon the readings of a position sensor. Since each transducer or sensor 
broadcasts at its own rate, there will not be samples from two transducers with the exact same 
time stamp. The resultant value for a transducer is calculated by interpolating the values 
from the other transducer. 

[000109] The following example is intended to illustrate how to interpolate these dependent 
values in a system of three transducers. The system includes an attitude sensor Sa; a position 
sensor Sp; and an image sensor Si. The system broadcasts the following clusters depicted in 
Fig. 20 with the specified time stamps. 

[000110] Tai-2456, attitude (pitch, roll, heading) 

[000111] Til, 2635, image 
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[000112] 



Tpl, 2762, position (latitude, longitude, altitude) 



[000113] Ti2, 2789, image 
[000114] Ti, (32nd pixel) 
[000115] Ta2, 2812, attitude 
[0001 1 6] Ti2, 2893 , image 
[0001 1 7] Tp2, 29 1 0, position. 

[0001 1 8] In this example simplified to illustrate the concept, the image sensor has 1 00 TCF 
in each cluster. Each TCF is one tick later in the time stamp. It is possible to calculate the 
point on the earth to which a set of pixels (samples) in a picture is pointing. For example if 
the first sensor image is initaited at time stamp 2789, as shown, and the 32nd pixel in the 
cluster has time stamp 2821, i.e. 2789+32 (one tick per pixel). The time in quesiton i.e. of the 
32nd pixel Ti is therfore: 2821. 

[0001 19] In order to calculate the postion (latitude , longitude and altitude ), an 
interpolation is performed based on the readings taken at time stamps Tpl=2762 and 
Tp2=2910 which bracket the time T-2821. 

[000120] The position at time T=2821 is calculated by interpolating between time stamps 
for Tpl=2762 andTp2=2910. 

[000121] Likewise, the camera attitude (pitch, roll, heading) for the time in question, i.e. 
T=2821 may be intrpolated from the attitude readings taken at Tal= 2456 and Ta2=2812 
from the data shown above. 



[000122] The invention may be described as a method and apparatus for acquiring in a 
universal way transducer data from the plurality of diverse sensors or emitters. The method 
is particularly useful for efficient and accurate real-time capture and observation of the data. 
The invention facilitates real time capture and utilization of the data because the data is 
presented in such a way that pertinent information is modeled in accordance with the 
Transducer Characteristic Frame (TCF). As a result, the data follows a scheme which is 
uniform and and self consistent, and which permits the system to readily accept new forms of 
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transducers as they become available without significant modification of the system. In 
short, the system accepts transducers as so called "plug and play" devices. 

[000123] The invention allows for accurate and precise acquisition of transducer data which 
may be readily processed, interpreted, archived and retrieved with known accuracy and 
precision and without corruption of the acquired data. 

[000124] The universality of the data format allows for the importation of the data by 
standard communications protocols. 

[000125] The invention compartmentalizes the information associated with each transducer 
sensor in such a way that it is possible to collect the information with reduced overhead. 

[000126] Transducers have diverse characteristics tailored to function or performance 
requirements. However, any transducer may be characterized in accordance with the model 
described herein which exemplifies the essential characteristics of the transducer. The TCF 
is only part of the characterization. . Thus there is a self consxstency of all models of the data 
for any transducer. 

[000127] It should be understood that the sensor response is fully still characterized by the 
"what", "where", and "when" characteristics. The "what" characteristics describe: what is 
being measured; encoding and formatting rules are used to describe the measurement; the 
units of the measurement; the uncertainties (absolute and relative) of the measurement; the 
frequency response of the detector; the input-output transfer function; and the instantaneous 
field of view. 

[000128] The "where" characteristics describe where (spatial position) in space the 
measurement corresponds. The spatial relationship of the sensor with respect to the platform 
is characterized by the sensed orientation of the platform and a time tag. If one wishes to 
characterize the position of the platform relative to some other location, for example, an earth 
surface station, the position and orientation of the platform relative to the earth is sensed and 
time tagged. 

[000129] The "when" characteristics describe when in time the measurement corresponds. 
A time tag (tick) maintains relative timing between samples and frames, and an absolute time 
can be measured with a time sensor measurement which has a relative time tag associated 
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with it. Time tags give relation timing between TCFs. The timing TCF gives relative timing 
within the TCF and the world clock sensor provides absolute time. Time tag in start tag of 
world time sensor correlate world time to system time tag. 

[000130] If one wishes to know the relationship of a sensor relative to some remote 
location, it is necessary only to look at the various data and correlate the information by 
interpolation. In other words, the sensor data may be fused or summed with the platform 
data; and the platform data may be fused with the earth station data. In short therefore, it is 
only necessary to collect "what"; "where" and "when" data necessary to relate the 
components in time and space. It is not necessary to calculate the various relationships 
among the components. Accordingly, the raw data for each sensor is collected independently 
of other sensors, The arrangement therefore simplifies data collection because complex 
calculation steps are not performed prior to collecting and characterizing the data. The 
arrangement thus avoids problems associated with data corruption, because data is preserved 
as it is taken without modification. 

[000131] In Fig. 19 the chain of relationships is traceable back to some desired reference 
point e.g. an Earth Centered Earth Fixed Reference ECEF system. All sensors should be 
traceable to ECEF. As shown, the position of the aircraft A relative to the Earth is defined by 
the earth platform vector R 2 , which can be characterized as a absolute radial distance with an 
azimuth and elevation. Alternatively, the vector 2 may be characterized by Cartesian or 
spherical coordinates. 

[0001 32] As can be appreciated, any consistent coordinate system may be employed to 
characterize these data. Accordingly, it possible to know in real-time the position/attitude 
with respect to the sensor relative to the ECEF reference system. The above described 
characterization of sensor data transforms one reference system, for example, the reference 
system of the sensor to an ECEF reference system. 

[000133] In order to model the sensor data and represent it as a temporal model, each 
sample must have associated with it the time when it was acquired and what was being 
sampled at that instant. For example, in the sensor data frame, there will be associated data in 
similar arrays to describe the timing and spatial data for each sample. The values in each 
corresponding location of the timing tables relate to the relative time that the sample was 
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acquired in relation to the other samples in the frame. The sampling rate within a TCF as 
well as the rate at which TCF are acquired may be quite different for different sensors. 

[000134] Fig. 21 illustrates this concept. Sensor 1 data occurs at a higher frequency and as 
different times than sensors 2-4. this is because it may be necessary to receive data which 
changes frequently, e.g. image data more often than condition data, e.g., temperature. 
According to the invention, all data is time tagged so that the relationship of the data from 
any Sensor may be related temporally to any other sensor. As previously noted, the data for 
any sensor may be interpreted to relate it to a time tagged sample of any other sensor. 

[000135] As noted above, it should be understood that the sampling order and transmission 
order maybe very different. Data may be acquired in a certain sequence and transmitted in 
yet a different sequence and the received data maybe unscrambled at the receiving station in 
order to reconstruct the image or data. In this connection the spatial data, i.e. spatial vectors, 
may likewise be unscrambled using the a-priori information characterizing the sensor. For 
example, if a series of vector values are transmitted in a transmission order, the receiving 
station, being responsive to the vector values, may unscramble the data by comparing the 
vector information transmitted with the vector map of the sensor frame. In other words, each 
spacial vector defines or characterized the corresponding sensor sample, including the 
location of the data in the sensor frame, and thereby orders the data accordingly. Indeed the 
transmission of sensor response samples may be random, but as long as the corresponding 
spatial coordinates (i.e. vectors) are scrambled in the same order as the sensor response 
samples, the sampling order can be recovered by sorting the vectors in the spatial frame, then 
sorting the response frame in a similar manner. 

[000136] Fig. 22 generally illustrates the overall system 100 according to the invention, 
employing a collection system 102 and a processing system 104 coupled over a link 106. 
The collection system 102 includes one or more sensors producing data 108. Each sensor has 
a corresponding model 1 10. Data generated by the various sensors 108 is transmitted over 
the link 106 in a common data and sensor model format. The processing system 104 includes 
an application module 112 which receives and reads the data. The application module 1 12 is 
responsive to a library 1 14 of common data format processing functions. Accordingly, all of 
the sensors may be modeled in the same way and their outputs may be processed and 
interpreted in a common and uniform way. The uniform modeling of all data of a transducer, 
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in effect, constitutes preprocessing of data in such a way that it is self consistent and 
uncorruptable. 

[000137] In contrast, Fig. 23 shows a conventional arrangement. In this arrangement, 
sensor data is collected in a common format. Typically this is a proprietary format which 
does not include a model of the sensor. The sensor data is sent to the processing system, 
where the application employs a unique sensor model to process the data. The disadvantage 
is that each time a new sensor is developed, a new model must be incorporated into the 
system. Whereas, with the invention, the models are transmitting with the data and the sensor 
consistent. In conventional systems, processing occurs concurrently with or before modeling. 
Therefore, the data is not self consistent and may be corrupted before it is archived. 

[000138] Fig. 24 illustrates an airborne collection system 120 in which the data from 
sensors 122-1 . . . 122-n is formatted in data formatter 124 and transmitted over the link 126. 
The airborne system also includes ancillary data means 128-1 . . . 128-n for each corresponding 
sensor 122-1 .122-n. The ancillary data means may be tailored for the corresponding sensor 
model. The ancillary data is sent along with the sensor response in a data stream 128 as 
illustrated. The transducer data description may likewise be transmitted at the 
commencement of the transmission. 

[000139] Fig. 25 illustrates a ground or terrestrial receive, process and display station 130 in 
which the data carried over link 126 is coupled to input parser 132 which separates or 
demodulates the data for each sensor into separate streams 134-1 . . ..134-n respectively. The 
streams include the sensor data and sensor data description for each sensor. The data is 
coupled to a processor module 136 including a processors 138-1 . . .138-n for processing the 
sensor data for each sensor; and a corresponding configuration module 140-1 . . . 140-n for 
processing the sensor data description in order to properly configure the processor handling 
the sensor. Each processor 138-1 . . .138-n may be coupled to an appropriate display 142- 
1 . 142-n. It should be understood that the various processing, display and configuration 
modules may be combined in an appropriate workstation as desired. 

[000140] As illustrated, the sensor data description is appropriately matched in the 
processor 136 for the sensor data to be processed . The software libraries, 142 are adapted to 
facilitate the universal interpretation of sensor data in the processor. 
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[000141] The model of the sensor system topology describes the relationship of the various 
sensors used in the multi sensor system. This modeling provides a cohesive picture to fuse 
all of the data together for the various sensors on board a platform. This model describes the 
chain of sensors and what parameters, if any, are modified by previous sensor measurements 
in the chain. For example, a detector look direction relative to a transducer is modified by 
the gimbol angles relative to the internal measurement sensor of the platform and the latitude 
of the platform relative to earth. This sensor environment data enables vectors to be 
manipulated and common reference frames to be converted into other common reference 
frames. 

[000142] According to the invention, only appropriate parameters need to be captured such 
that the measurement errors can be accumulated throughout the chain to give the processes 
indication of resultant measurement error 

[000143] From the foregoing it can be seen that it is possible to tie each sample and the 
sensor response frame to each sample in the timing and spatial frame. Accordingly, each 
sample can be mapped to any surface with relative ease. The arrangement provides for rapid 
targeting based solely on data collected from the sensor system. 

[000144] In accordance with the invention the sensor data and metadata to describe the 
sensor are packaged in a form for transport to a remote location or to an archive. The shell is 
generic and uses a compatible markup language as a carrier for the data elements of the 
model, e.g.: transducer markup language (TML). The shell does not add significant overhead 
to the basic data elements. 

[000145] The following is a description of the transducer markup language (XML) 
employed in the invention. The description has the material subdivided into a series of 
sections with section headings followed by TML text and, where appropriate, followed by 
explanatory text discussing the feature of interest. 

[000146] Stream header 



<! ELEMENT transducerML (system, (system_update* |data*) ) > 
< ! ATTLIST transducerML 
version CDATA #FIXED "0.9beta"> 



[000147] The TML document represents a stream. The opening tag initiates the stream. A 
closing tag terminates the stream. The first element in the stream should be a system 
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element. The remainder of the stream is any sequence of s ys t em_upda t e elements and 
data elements. 



<?xml version^" 1 . 0" ? > 
<transducerML versions" 0 . 9beta"> 
<system> 

. . . system elements • . . 
</system> 

<data> - . - </data> 
<data> . - . </data> 

<system_update> . . . </system__update> 
<data> . . . </data> 

<system__update> . . . </system_update> 
<data> . . - </data> 
<data> - . . </data> 



< / 1 ransduce rMLs 



"[000148] The element transducerML is the default root element. Specific protocol 
implementations of TML may need to replace the root element. 

[000149J The default root element designates the version of the schema (document type). 
When implement in protocols, the namespace designation for the elements will indicate the 



version. 



lp7protocolRoot xmlns":p="myprotocol .xom/ns/foo» 
*™ lns tml= "http : / / transducerml . org/ ng^gbeta > 



[000150] System 



71 ELEMENT system (model's, sensors , dependencies) > 



< 1 ATTLIST system 
id ID #REQUIRED> 



[000151] System contains a sequence of models, sensors and dependencies, in that order. A 



system has a unique identifier. 



<system id= "SysOOl" > 

<models> . . . < /model s> 

<sensors> ... </sensors> 

<dependencies> . . . </dependencies> 
</system> — 



[000152] Models 



< i ELEMENT mode 1 s ( mode 1 * ) > 

< I ELEMENT model (description? , datapomts) > 
< [ ELEMENT datapoints (# PCD ATA) > 



"[000153] The models element contains zero or more model elements. The model element 
contains a datapoints element and may contain a description element. The description 
element is generic throughout the schema. 



26 



DC01Y71597.1 
IDNJPD 



<models> 

<model id="M0 001"> 

<descript ion> , , , 

<property name=« nomenclature" >£ requency response model</property> 

:aataSnts°count=»15»>0 0.1 0.2 0.S 0.7 0.9 1.0 1.0 1.0 0.9 0.7 0.S 0.2 0.1 
0</datapoints> 
< /model > 

^Uoirs^o^t^^'^^S .67 .81 .92 1.00 .92 .81 .67 . 45</datapoints> 
< /model > 

<model id-"M0003"> g - 98 

<datapoints COunt=" 15" > . 01 .015 .13 .21 .30 .42 .50 .58 .69 .78 .82 .88 .91 .98 

1 . 00</datapoints> 
</model> 

<model id="ST001"> 

<datapoints count=" 1000000" / > 
</model> 

< / mode 1 s > — - - 



[000154] A model has an identifier unique within the system definition. 

[000155] A model defines a curve. The data points are evenly distributed across the x-axis. 
The values are the positions relative to the y-axis. The sample model M0001 defines the 
curve shown in Fig. 27. 

[000156] An empty set of data points such as model ST001 means that all of the values are 
zero. 

[000157] Sensors 



<! ELEMENT sensors (sensor*) > 

<! ELEMENT sensor (description, frame) > 

< ! ATTLIST sensor 

id ID # REQUIRED 

urn CDATA #IMPLIED> 



[000158] Sensor URN 



[000159] A sensor has a identifier unique within the system definition. Preferably, sensosrs 
would use a uniform resource name (URN) as their identifier. In a protocol implementation, a 
stream could begin with a simple empty sensor element as follows: 



csystem 



7Hl" S pn R nrl» urn= "urn :'x-dod trans ducer : af : 123456789- 102 " /> 



[000160] The subscriber could check if it has this sensor definition already locally stored. If 
not then the subscriber could look up the sensor in some well-known repository. If that 
should fail, then the subscriber could ask the publisher to send the complete sensor definition. 

[000161] Within the stream, elements would reference the stream by its shorter ID attribute 
rather than its longer URN attribute. 
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[000162] Frames 



< ! ELEMENT frame (ST_model , sample) > 
< ! ATTLIST frame 

count C DATA # RE QUI RE D > 

[000163] A sensor contains a description and a single frame. A frame contains an space- 
time model and a single sample definition. 

[000164] The data elements within the TransducerML stream represent a cluster. A cluster 
may contain one frame, multiple frames, or a fraction of a frame. The number of frames 
within a cluster remains consistent for a particular sensor. The count attribute indicates the 
number of frames per cluster. 

[000165] Some sensors such as sound have very small frames. It is useful to bundle several 
small frames into a single data element (cluster) to reduce overhead. 

[000166] Dividing a frame that is especially large (more than 500 kilobytes?) may make it 
easier to parse and check for errors. If a cluster is a fraction of a frame, then the count 
attribute will be less than 1, as in "0.25". A sequence of clusters, that is data elements, that are 
the same frame would all have the same time stamp. 

[0001 67] Space-time model 



<! ELEMENT ST_model (time? , axis* , sequence? ) > 
< ! ATTLIST ST_model 

scf dimension CDATA # REQUIRED 
osJoord_sys (polar | cartesian) #REQUIRED> 
< ! ELEMENT t ime (model , property* ) > 
< ! ELEMENT sequence (model , property* ) > 
< 'ELEMENT axis (model , property* ) > 
< l ATTLIST axis 

map CDATA _ # RE QUI RED> 



[000168] A space-time model has a time model, zero or more axis models and a sequence 
model. The scfjiimension attribute indicates how many axis models there should be. 



<STjmodeT~s^ 2" os_coord_sys=" polar" > 

<time> 

<model ref="ST001"/> 

^property name-" time_interval" >1E- 3</property> 
<property name=" temporal_accuracy" >1E- 6</property> 
</time> 

<axis map="x"> 

<model ref="ST001"/> 

<property name=" axis_assoc" >alpha< /property > 
<property name =" range" >1 . 2</property> 
<property name=" tics" >10000</property> 
<property name=" samples" >1000</property> 
</axis> . 
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<axis map="y"> 

<model ref="ST001"/> 

<property name=" axi s_assoc" >be ta< /property > 
<property name=" range" >1 . 2 < /property > 
<property name="tics" >10000</property> 
<property name =" samples" >100 0</property> 
</axis> 

< / S T_mode 1 > 

[000169] With each of these examples, the models are straight zeroes, meaning that the 
samples are all instantaneous. A more complex example is provided later in this document. 

[000170] Sample 



<! ELEMENT sample (measurement*) > 
< ! ATTLIST sample 

count CDATA #REQUIRED> _ _ 

[000171] A frame consists of samples. The space-time model defines the relationship of the 
samples to space and time. A frame will have a set number of samples. For example, if the 
sensor provides an image that is 1000 x 1000 pixels, then the sample size is 1 million. 

[000172] Each sample consists of one or more measurements. If the sensor provides a 
monochromatic image, then each sample is one measurement of a gray scale. If the image is 
color, then each sample is three measurements for red, green and blue. Multi-spectral analysis 
can actually create thousands of measurements for each sample. 

[000173] Measurements 



| < ! ELEMENT measurement (description, encoding, (property | characteristic )*) > 
| <! ATTLIST measurement 
| id ID #REQUIRED>___ 

[000174] A measurement contains a description and an encoding followed by zero or more 
properties or characteristics in any order. 



< sample count =" 1000000" > 

measurement id=" S001E001" > 
<description> 

<property name=" nomenclature" >spatial module monochrome incident 
light < /property > 

< /description 
<encoding> 

<bits>8</bits> 

<datatype>positive_int< /datatype > 
<units> lumens </units> 
<range>0 255</range> 
</encoding> 

<property name="abs_accuracy" >0 . 25</ characteristio 
<property name=" rel_accuracy" >0 . 01</characteristic> 
<property name="measure_duration" >15</ characteristio 
characteristic type=" f req_resp" > 
<model ref ="M0001"/> 

<prope rty n ame=" range" >4 00E-9</property> 
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<property name=" center" >500E- 9</property> 
</characteristic> 

characteristic type=" 3dbif ov_alpha" > 
<model ref ="M0002"/> 

<property name=" scale" >500</property> 
<property name="azimuth_range" > . 0012</property> 
</characteristic> 

characteristic type=" 3dbif ov_beta" > 
<model ref = // M0002 ,/ /> 

<property name=" scale" >500</property> 
<property name="azimuth_range" > . 00 12 < /property > 
</characteristic> 

<characteristic type=" stim_resp__f en" > 
<model ref="M0003"/> 

<property name="gain" dependency_ID="S001E001Dl" /> 
<property name="bais" >0</property> 
</characteristic> 
< /measurement > 
</sample> 

[000175] Encoding 



< ! ELEMENT encoding (bits, datatype, units, range) > 

<» ELEMENT bits (# PCDATA) > 

< ! ELEMENT datatype (# PCDATA) > 

<! ELEMENT units (# PCDATA) > 

<! ELEMENT range (# PCDATA ) > 

[000176] An encoding defines bits, data type, units and range. These particular 
characteristics of a measurement must be present for all measurements, so they are not treated 
genetically using a characteristic element. The encoding children are used to parse the data 
elements. 



<sensor> 

< frame count ="1" > 

<sample count= 11 10000 " > 
<measurement > 
<encoding> 

<bits>6</bits> 
</ encoding > 
< /measurement > 
<measurement> 
<encoding> 

<bits>8</bits> 
</encoding> 
< /measurement > 
<measurement > 
<encoding> 

<bits>6</bits> 
</ encoding > 
< /measurement > 
</ sample > 
</f rame> 

</ sensor > 

[000177] The previous fragment defines a sample of three measurements. For simplicity of 
explaination, the example above does not include some mandatory elements which are not 
relevant to the discussion. The first measurement is 6 bits, the second is 8 bits, and the third 
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is 6 bits. The total sample is 20 bits, which can be expressed with 5 hexadecimal characters 
shown in Fig. 28. 

[000178] Using the sample encoding, the hex string "558B1" would represent a first 
measurement value of 13, a second measurement value of 57 and a third measurement value 
of 9. 

[000179] Padding 

[000180] Measurements are given in bits. The character data within the data elements is in 
hexadecimal encoding (0-9A-F) to avoid any special characters that would choke the XML 
parser. If the measurements do not map evenly over four bits, then the character data is 
padded with zeroes at the very end of the cluster. 

[000181] Characteristics 



< [ELEMENT characteristic (model? , property* ) > 
< ! ATTLI ST characteristic 

type CDATA #REQUIR ED> _ _ 



[000182] Characteristics provide more fidelity than properties. A characteristic element can 
contain a model element and zero or more property elements. Characteristics enable us to 
communicate complex properties such as frequency response. For instance, the following 
characteristic tells us that the frequency response is a typical bell curve extends from 300 uHz 
to 700 uHz. 



^USiS^t-lB^O O.X 0.2 0.S 0.7 0.9 1.0 1.0 1-0 0.9 0.7 0.S 0.2 0.1 

0</datapoints> 

< /model > 

characteristic type-" f req_resp" > 
<model ref ="M0001"/> 

<property name="range" >400E-9</property> 
<property name="center" >500E- 9</property> 
< / char ac t er i s t ic > _ _ : — — - — - 



[000183] The frequency response characteristic is shown in Fig. 28. 
[000184] Properties 



<! ELEMENT description (property*) > 
<! ELEMENT property (# PCDATA) > 
< ! ATTLI ST property 

name CDATA # REQUIRED 

dependency_ID ID #IMPLIED> 
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[000185] Descriptions and properties are generic to this schema. Descriptions are a 
collection of properties. Properties are simple name-value pairs. We take this generic 
approach for two reasons. First, it is impossible to anticipate all the properties necessary to 
communicate transducer information. Second, we are able to treat all properties generically 
for display purposes or use within tools. 

[0001 86] Measurement value dependencies 

[000187] The attribute dependency JD is set for reference later in the dependencies section. 
For instance, this characteristic flags the gain property of the stim_resp_fcn (stimulus 
response function) characteristic as dependent upon some other sensor's measurement value. 
A dependency will reference this dependency identifier in the dependencies section of the 
system definition. 



^characteristic type=" stim_resp_f cn" > 
<model ref="M0003"/> 

<property name="gain" dependency_ID=" S001E001D1" /> 
<property name="bais" >0</property> 
< / charac teristio _ 



[0001 88] Dependencies are defined outside of the sensor definition in order to enable plug- 
and-play of sensors into different systems. 

[0001 89] Dependencies 



<! ELEMENT dependencies (dependency* ) > 

<! ELEMENT dependency ( (attached) (position? , attitude? ) ) , dependent_value* ) > 
< I ATTLIST dependency 

sensor_ref IDREF #REQUIRED> 
< 1 ELEMENT attached (EMPTY) > 
<! ATTLIST attached 

sensor_ref IDREF # REQUIRED > 
<! ELEMENT position (x,y,z)> 
< ! ATTLIST position 

sensor_ref IDREF # RE QUI RED > 
< ! ELEMENT x (measurement_value | (value , abs_accy ) ) > 
< ! ELEMENT y (measurement_value | (value , abs__accy ) ) > 
< ! ELEMENT z (measurement_value j (value , abs_accy ) ) > 

< I ELEMENT attitude (omega, phi , gamma) > 
< 'ATTLIST attitude 

sensor_ref IDREF #REQUIRED> 
<1 ELEMENT omega (measurement_value | (value , abs_accy) ) > 
< ! ELEMENT phi (measurement_value | (value , abs_accy) ) > 
< ! ELEMENT gamma (measurement_value | (value , abs_accy ) ) > 

<! ELEMENT dependent_value (measurement_value) > 
<! ATTLIST dependent_value 

ref IDREF #REQUIRED> _ ~~ 
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[000190] The dependencies section enables us to plug-and-play sensors together into a 
system definition. We are primarily concerned with plugging together the position and 
attitude of sensors. The position and attitude are the key properties necessary for most sensor 
fusion efforts. However, any property of a sensor can be dependent upon another sensor 
measurement. 

[000191] The dependencies element contains zero or more dependency elements. Each 
dependency element references a particular sensor by its unique identifier. All the 
dependencies for a particular sensor should be defined within a single dependency element. 

[000192] A dependency element contains either an attached element or a position and 
attitude element followed by zero or more dependent_value elements. 



<dependencies> 

<dependency sensor_ref =" S001" > 
<position sensor ref="S002"> 

<x>«value»l2 . 005</valuexabs_accy> • 001</abs_accyx/x> 
<vxvalue>-4.452</valuexabs_accy>.0Oi</abs_accyx/y> 
<zxvalue>0 . 2136</valuexabs_accy> . 001</abs_accyx/z> 
</position> 

<attitude sensor ref="S002"> 

<omegaxvalue>T86</valuexabs_accy> . 01</abs_accyx/omega> 
<phixvalue>-.86</valuexabs_accy>.0K/abs_accyx/ph 1 > 
<gammaxvalue> . 13</valuexabs_accy> . 0l</abs_accyx/gamma> 

</attitude> , „_ 

<dependent_value ref =»S001E001D1" ><measurement_value 

ref = "S005E001"/x/dependency_value> 
< / dependency > 

<dependency sensor_ref ="S002" > 
<position sensor_ref="S003"> 

<xxvalue>l . 030</valuexabs_accy> . 001</abs_accyx/x> 
<yxvalue>-4 . 452</valuexabs_accy> . 001</abs_accyx/y> 
<zxvalue>0 . 213</valuexabs_accy> . 001</abs_accyx/z> 
</position> 
<attitude sensor ref ="3004" > 

<omega><measuriment_value ref =''S002E001»/></omega> 
< P hiLvalue>-0 . 34</value><abs^accy> . Ol</abs„accy></phx> 
<gammaxvalue>.13</value><abs_accy>.01</abs_accyx/gamma> 

</attitude> 
</dependency> 

<dependency sensor_ref ="S0 03" > 
<position sensor_ref ="ECEF"> 

<xxmeasurement_value ref = "S003001" /x/x> 
< y ><measurement_yalue ref = "S003001" /></Y> 
<zxmeasurement_value ref = "S003001"/x/z> 
</position> 
</ dependency > 

dependency sensor_ref =" S004" > 
<attitude sensor ref="ECEF"> 

<omegaxmeasuriment_value ref -S004E001'' /></omega> 
<phixmeasurement_value ref = "S004E001" /></ph!> 
<gammaxmeasurement_value ref = «S004E001" /></gamma> 
</attitude> 
</ dependency > 

<dependency sensor_ref = ' / S005' / > 

<attached sensor_ref =" S001" / > 
< / dependency - 
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[000193] Attached, Position and Attitude 

[000194] An Attached element is empty and simply references another sensor. The presence 
of an Attached element means that the sensor referenced by the dependency element should 
be treated as if it had the exact same location and attitude as the sensor referenced by the 
Attached element. 



^dependency sensor_r ef = " S 0 0 5 " > 

cattached sensor_ref="S001"/> 
</ dependency > 



[000195] The Position element defines the x, y and z dimensional position of a sensor 
relative to another sensor. The difference is simple arithmetic. The value added can be either 
a number or a measurement value reading. If it is a number, then it must be accompanied by 
an accuracy value. The following fragment states that the position of sensor S001 is 
dependent upon the location of sensor S002. 



^dependency sensor_ref =" S001" > 
<position sensor_ref ="S002" > 

<xxvalue>12 . 005</value><abs_accy> . 001</abs_accyx/x> 
<yxvalue>~4 . 452</valuexabs_accy> . 001</abs_accyx/y> 
<zxvalue>0 . 2136</valuexabs_accy> - 001</abs_accyx/z> 
</position>_ 



[000196] The Attitude element defines the omega, phi and gamma (©,q>,y) angle positions 
of a sensor relative to another sensor. The Position and attitude of a particular sensor can be 
dependent upon different sensors. 

[000197] Measurement references 

[000198] Changes in position and attitude are calculated from sensor Measurements. The 
measurement_value element defines the dependency. The measurement_value element 
references the unique identifier of a sensor sample measurement defined in the sensors 
section. 



< dependency sensor_ref ="S004" > 
<attitude sensor__ref = "ECEF" > 

<omegaxmeasurement_value ref = " S004E001" / ></omega> 
<phixmeasurement_value ref = »S004E001" / x/phi> 
<gammaxmeasurement_value ref = " S004E001" /x/gamma> 
< / a 1 1 i t ude > — — 
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[000199] Any sensor property can be dependent upon another sensor measurement. The 
following completes the dependency of the gain property for a sensor upon the measurement 
of another sensor. 



<sensors> 



<property name="gain" dependency_ID=" S001E0 01D1" / > 

<dependencies> ... 

<dependent_value ref = ''S001E001D1" ><measurement_value 
ref = "S005E001 ,/ /></dependency _value> 



[000200] Data 



<! ELEMENT data (# PCDATA) > 

< ! ELEMENT data 

ref IDREF # REQUIRED 
Stamp CDATA # RE QUI RED > 



[000201] See section [000175] Encoding. 
[000202] System updates 



T-'eEeSent system_update (model* ^ # S ensor_update* ;dependency_update*) > 
< ! ATTLIST system_update 

stamp CDATA # REQUIRED > 
<!ELEMENT sensor_update (description? , frame? ) > 
< ! ATTLIST sensor_update 

< , SSSr I £p2SSSS D ( (attach | (position, , attitude, ) ) , dependence* , > 
< ! ATTLIST dependency_update 

sensor ref IDREF # RE QU I R E D > — — — 



[000203] A system of sensors may change after the stream of data has begun. These 
changes come as system_update elements. The system_update can contain new models, 
sensor updates or dependency updates. For sensor updates and dependency updates, only the 
information that has changed is sent. Updates are sent within the proper nested elements. 

[000204] In the following example, only the frequency response (freq_resp) characteristic 
of measurement MS001E001 has changed. However, measurement characteristics are nested 
within sensor, frame and sample elements. A graphical representation of the frequency 
response is shown in Fig. 27, (which has been earlier exemplified as a model curve.) 



<system_update timestamp=" > 
<model id="MX009"> 

<datapoints> . . . </datapoints> 
</model> 

<sensor_update ref="S00l"> 
<f rame> 
<sample> 
measurement ref ="MS001E001" > 

characteristic type=" f req_resp" > 
<model ref="MX009"/> 

<property name=" range"j>4 0^z?Jl/ property> 
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<property name=" center" >500E- 9</property> 
</characteristic> 
</measurement> 
</ sample > 
< / f r ame > 
</sensor_update> 
</system_update> 

[000205] Space-Time model example 



<models> 






<model id="MA-X" > 


-30 30 45 50 32 - 


32 - 


cdatapoints counts" 16" >- 50 -32 32 50 45 30 -30 -45 -45 


5 0 < / da tapo int s > 






< /model > 






<model id="MA-Y"> 


-30 -32 -50 -45 - 


45 - 


<datapoints count="16">50 45 45 50 32 30 30 32 -32 -30 


50</datapoints> 






< /model > 






<model id="MA-S" > 


13 12</datapoints 




<datapoints count="16">0 1 2 3 7 6 5 4 8 9 10 11 15 14 




</model> 






<model id=" MA-T" > 






<datapoints count="16">0 2 4 6 8 10 12 14 16 18 20 22 


24 26 28 30</datapomts> 


< / model > 






<r /mnripl s > 

^ / L L IVV V — -1. *J *** 






<ST model scf _dimension=" 2" os_coord_sys="polar"> 






<time> 






<model ref="MA-T"/> 






<property name="time_interval" >lE-3</property> 






<property name="temporal_accuracy" >lE-6</property> 






</time> 






<axis map="x"> 






<model ref = /, MA-X ,/ /> 






<property value="axis_assoc" >alpha</property> 






<property value=" range" > 1 . 2 < /property > 






<property value=" tics" >101</property> 






<property value=" samples" >4</property> 






c / axis> 






<axis map="y"> 






<model ref="MA-Y"/> 






<property value="axis_assoc" >alpha</property> 






<property valuer" range" >1 . 2</property> 






<property value=" tics" >101</property> 






<property value=" samples" >4</property> 






</axis> 






<sequence> 






<model ref="MA-S"/> 






</sequence> 






</ST model > 







[000206] Sequence model 



<model id="MA-S"> 

<datapoints count = "16">0 1 2 3 7 6 5 4 8 9 10 11 15 14 13 12</datapomts> 
< / model > _ _ — — 

[000207] The sequence model is read left-to-right, top-to-bottom, front-to-back across the 
dimensions of the space model. In this case, the x-dimension and y-dimension are both 4, as 
indicated in their sample property. 
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1 


2 
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7 


6 


5 


4 


8 


9 


10 


11 


15 


14 


13 


12 



[000208] The other data points map to the physical dimensions in the sequence specified in 
the sequence model. 



<m :?aUo = in^"^nt = »l 6 »>-S0 -32 32 SO 45 30 -30 -45 -45 -30 30 45 50 32 -32 - 
50</datapoints> 

< / mode 1 > „ „ „ - — - - " " " 



-50 


-32 


32 


50 


-45 


-30 


30 


45 


-45 


-30 


30 


45 


-50 


-32 


32 


50 



[000209] Document type definition 



^1 _ TransducerML DTD vers ion 0 . 9beta 
Copyright ® 2003. Iris Corporation. 



< I ELEMENT transducerML ( system, ( system_update* | < 
< I ATTLIST transducerML 

version CDATA #FIXED "0.9beta"> 
< I ELEMENT system (model s , sensors , dependencies) > 
< I ATTLIST system 

id ID #REQUIRED> 
<! ELEMENT models (model*) > 

< ! ELEMENT model (description? , datapoint s ) > 

< ! ELEMENT datapoints (#PCDATA) > 

< ! ELEMENT description (property*) > 

<! ELEMENT property (# PCDATA) > 

< ! ATTLIST property 

name CDATA #REQUIRED 

dependency_ID ID #IMPLIED> 

<! ELEMENT measurement_value EMPTY> 
< ! ATTLIST measurement_value 

ref IDREF #REQUIRED> 
< t ELEMENT sensors (sensor*) > 
< • ELEMENT sensor (description, frame) > 
< i ATTLIST sensor 

id ID # REQUIRED 

urn CDATA #IMPLIED> 

< I ELEMENT frame (ST_model , sample) > 

< ! ELEMENT ST_model (time? , axis* , sequence? ) > 

<! ATTLIST ST_model 

scf dimension CDATA # REQUIRED 

os_coord_sys (polar | cartesian) # RE QUI RED > 

< ! ELEMENT time (model , property* ) > 
< ! ELEMENT sequence (model , property* ) > 
<! ELEMENT axis (model , property* ) > 
<! ATTLIST axis 

map CDATA # REQUIRED > 
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! ELEMENT sample (measurement*) > 
! ATTLIST sample 

,SSL?!SJS2S^S.-criptio«. encoding, (property | characteristic) > 
•ATTLIST measurement 
id ID #REQUIRED> 

I ELEMENT encoding (bits, datatype, units, range) > 
•ELEMENT bits (# PCDATA) > 
•ELEMENT datatype (# PCDATA) > 
« ELEMENT units ( # PCDATA ) > 
•ELEMENT range (# PCDATA ) > 

•ELEMENT characteristic (model? , property* ) > 
•ATTLIST characteristic 
type CDATA #REQUIRED> 

• ELEMENT dependencies (dependency* ) > ^^^f- ^ 1llP *u 

•ELEMENT dependency ( (attached | (posit ion? , attitude? )), dependent_value )> 

•ATTLIST dependency 

sensor_ref IDREF #REQUIRED> 
! ELEMENT attached (EMPTY) > 
< I ATTLIST attached 

sensor_ref IDREF #REQUIRED> 
<! ELEMENT position (x,y,z)> 
<! ATTLIST position 

sensor_ref IDREF #REQUIRED> 
< ! ELEMENT x (measurement_value | (value , abs_accy) ) > 
< ! ELEMENT y (measurement_value j (value , abs_accy) ) > 
< ! ELEMENT z (measurement_value | (value , abs_accy) ) > 

< ! ELEMENT attitude (omega , phi , gamma) > 
< ! ATTLIST attitude 

sensor_ref IDREF #REQUIRED> 
< ' ELEMENT omega (measurement_value | (value , abs_accy ) ) > 
< • ELEMENT phi (measurement__value | (value , abs_accy ) ) > 
< ! ELEMENT gamma (measurement_value | (value , abs_accy ) ) > 

<! ELEMENT dependent_value (measurement_value) > 
< 'ATTLIST dependent_value 
ref IDREF #REQUIRED> 

<! ELEMENT datastream ( ( system_update | data) * ) > 
< \ ATTLIST datastream 

system ref IDREF #REQUIRED> 
<• ELEMENT system_update (model* , sensor_update* , dependency_update* ) > 
<• ATTLIST system_update 

Stamp CDATA #REQUIRED> 
< ! ELEMENT sensor_update (description? , frame? ) > 
<• ATTLIST sensor_update 

^S^otpe^^^ 
<! ATTLIST dependency_update 
sensor_ref IDREF #REQUIRED> 

<! ELEMENT data (# PCDATA) > 
< I ELEMENT data 

ref IDREF # REQUIRED 

stamp CDATA #REQUIRED>_ _ - — ~~ 



[000210] A comprehensive example follows. 



<?xml version=" 1.0"?> 
<transducerML version=" 0 . 9beta" > 
<system id="Sys001" > 
<models> 

<model id="M0001"> 
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<description> 

<property name= " nomenclature" > frequency response model</property> 
</description> 

<datapoints count="15">0 0.1 0.2 0.5 0.7 0.9 1.0 1.0 1.0 0.9 0.7 0.5 0.2 
0 . 1 0</datapoints> 
< /model > 

<model id="M0002"> 

<datapoints count=" 9" > . 45 .67 .81 .92 1.00 .92 .81 .67 . 4 5</datapoints> 
</model> 

<model id="M0003"> 

<datapoints count=" 15" > . 01 .015 .13 .21 .30 .42 .50 .58 .69 .78 .82 .88 .91 
.98 1 . 00</datapoints> 
</model> 

<model id="ST0 01"> 

<datapoints count =" 1000000" / > 

</model> 
< /model s> 
<sensors> 

<sensor id="S001" urn=" urn : x-dod : transducer : DB110- 12 34 56 78 9" > 
<description> 

<property name=" nomenclature" >Framing CCD LOROP Camera< /property > 

<property name="model_number" >DB110< /property > 

<property name=" serial_no" >1234 56789</property> 

<property name=" category" >primary< /property > 

<property name=" sensor_type" >remote</property> 

<property name=" stimulus_source" >ambient</property> 

<property name=" sample_rate" >3 51</property> 
</description> 
< f rame count = " 1 " > 

<ST_model scf_dimension="2" os_coord_sys="polar" > 
<time> 

<model ref ="ST001"/> 

<property name=" time_interval" >lE-3</property> 
<property name=" temporal_accuracy" > IE- 6 < /property > 
</time> 

<axis map="x"> 

<model ref ="ST001"/> 

<property name="axis_assoc" >alpha</property> 
<property name=" range" >1 . 2 < /property > 
<property name="tics" >10000</property> 
<property name=" samples" >1000</property> 
</axis> 

<axis map="y"> 

<model ref ="ST001"/> 

<property name="axis_assoc" >beta</property> 
<property name=" range" >1 . 2 < /property > 
<property name=" tics" >10000</property> 
<property name=" samples" >1000</property> 
</axis> 
</ST_model> 

<sample count=" 1000000" > 

<measurement id="S001E001" > 
<description> 

<property name=" nomenclature" > spat ial module monochrome incident 

light < /property > 

</description> 
<encoding> 

<bits>8</bits> 

<datatype>positive__int</ datatype > 
<units>lumens</units> 
<range>0 255</range> 
</encoding> 

<characteristic type="abs_accuracy" >0 . 25</characteristic> 
characteristic type = " re l_accuracy " >0 . 01</characteristic> 
characteristic type="measure_duration" >15</characterist ic> 
<characteristic type=" f req_resp" > 
<model ref ="M000l"/> 

cproperty na_me="^range v >4 00E- 9</property> 
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<property name=" center" >500E- 9</property> 
</characteristic> 

characteristic type=" 3dbif ov_alpha" > 
<model ref ="M0002"/> 

<property name=" scale" >500</property> 
<property name=" azimuth_range" > . 0012</property> 
</characteristic> 

<characteristic type=" 3dbif ov_beta" > 
<model ref ="M0002"/> 

<property name=" scale" >500</property> 
<property name="azimuth_range" > . 0 012</property> 
</ characteristic 

< characteristic type="stim_resp_f cn" > 
<model ref ="M0003"/> 

<property name="gain" dependency__ID=" S001E001D1" / > 
<property name= " ba i s " > 0 < / prope r t y > 
</characteristic> 
< /measurement > 
</ sample > 
</f rame> 
</sensor> 

<sensor id="S002"> 
</sensor> 
</sensors> 
<dependencies> 

<dependency sensor_ref ="3001" > 
<position sensor_ref = // S002 // > 

<xxvalue>12 . 005</value><abs_accy> . 001</abs_accyx/x> 
<yxvalue>-4 . 452</value><abs_accy> . 001</abs_accyx/y> 
<zxvalue>0 . 2136</valuexabs_accy> . 001</abs_accyx/z> 
</position> 

<attitude sensor_ref ="S002"> 

<omegaxvalue> . 86</valuexabs_accy> . 01</abs_accyx/omega> 
<phixvalue>- . 86</valuexabs_accy> . 01</abs_accyx/phi> 
<gammaxvalue> . 13</valuexabs_accy> . 01</abs_accyx/gamma> 

</attitude> 

<dependent_value ref ="S001E001D1" ><measurement_value 
ref = "S0 05E001"/x/dependency_value> 
</dependency> 

< dependency sensor_ref ="S002" > 
<position sensor_ref ="S003 " > 

<xxvalue>l . 030</valuexabs_accy> . 001</abs_accyx/x> 
<yxvalue>-4 . 452</valuexabs_accy> . 001</abs_accyx/y> 
<zxvalue>0 . 213</value><abs_accy> . 001</abs_accyx/z> 
</position> 
<attitude sensor_ref =" S004" > 

<omegaxmeasurement_value ref = "S002E001" / ></omega> 
<phixvalue>-0 . 34</valuexabs_accy> . 01</abs_accyx/phi> 
<gammaxvalue> . 13</value><abs_accy> . 01</abs_accyx/gamma> 
</attitude> 
</dependency> 

<dependency sensor_ref =" S003" > 
<position sensor_ref ="ECEF" > 

<xxmeasurement_value ref = "3003001" /></x> 
<yxmeasurement_value ref = " S003 0 01" /x/y> 
<zxmeasurement_value ref = " S003 001" / x/z> 
</position> 
< /dependency > 

< dependency sensor_ref ="S004" > 
<attitude sensor_ref ="ECEF" > 

< omega xmeasurement_value ref = "S004E001"/ x/omega> 
<phixmeasurement_value ref = "S004E001" /x/phi> 
<gammaxmeasurement_value ref ="S004E001" / >< /gamma > 
</attitude> 
< /dependency > 

<dependency sensor_ref ="S005" > 

<attached sensor_ref ="S001" /> 
< /dependency > 
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</dependencies> 
</ system> 

<data/> 

</transducerML> 

[000211] [ ]The attached CD ROM DISC contains a comprehensive example of 

Transducer and is part of the disclosure therein. 
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